You're not imagining vacant storefronts on Mission. There are 56 of them.
Mission Street has a high number of commercial vacancies, but it is still considered less desirable than nearby Valencia Street.
People are more inclined to stay on Valencia Street and are less likely to walk in the Mission Street neighborhood at night.